Building Generative AI-Powered Apps by Aarushi Kansal

Author:Aarushi Kansal
Language: eng
Format: epub
ISBN: 9798868802058
Publisher: Apress

Fine-Tuning Strategies

Full Model Fine-Tuning: All the weights in the model are updated during fine-tuning. This is often used when the fine-tuning dataset is large and diverse enough to warrant comprehensive retraining.

Partial Fine-Tuning: Only the weights of the last few layers are updated. In neural networks, this often means adjusting the weights of the layers closer to the output (the “head” of the model) while keeping the earlier layers (the “body” or “base” of the model) frozen. This approach is common when the new task is quite similar to the pre-training task, or when the dataset is smaller.

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.